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Abstract. We prove an equidistribution result for Hecke operators acting on the basic 
stratum of certain Shimura varieties. We relate the rate of convergence to the bounds from the 
Ramanujan conjecture of certain cuspidal automorphic representations on GL,i for which this 
conjecture is known, and therefore we obtain optimal estimates on the rate of convergence. 



Introduction 

Let S be an unitary Shimura variety of PEL type and consider a prime p of the reflex 
field where S has good reduction. The Newton stratification of S modulo p is a canonical 
decomposition of Sf^ into an union of locally closed subvarieties. These subvarieties are 
stable under the Hecke correspondences. We consider the supersingular stratum B of S'f, and 
assume B is finite. Thus we have a finite Galois set B{¥q) equipped with an action of the 
Hecke correspondences. For any point x G B(¥q) we study its orbit under sequences of Hecke 
operators. We give an explicit description of this orbit and show that the Hecke operators 
act with equidistribution. See Theorem 13.11 for the precise statement. 

The article consists of roughly two parts. In the first part we show equidistribution for 
Kottwitz varieties. Section 4 contains the proof; we use our automorphic description of the 
cohomology of B from [18] to prove equidistribution. The arguments are quite similar to [9|I10| . 

The class of varieties considered in [TB] is somewhat restricted, we considered a class of 
compact varieties where endoscopy does not play an essential role (the "Kottwitz varieties"). 
In Section [6] we extend the result from [loc. cit.] to a suitable statement valid for a sub- 
stantially larger class of non-compact endoscopic varieties. We require, roughly, that of one 
the signatures of the unitary group is coprime with n (Hypothesis 16. ip . We verify that this 
condition is always satisfied in case the basic stratum is finite. The assumption forces the en- 
doscopic contribution to the cohomology of the basic stratum to vanish (Lemma 16. 4p . These 
results (Theorem 16.21 Proposition 17. ip could be of independent interest. Finally, in Section [7| 
we deduce the equidistrubtion statement for the endoscopic varieties. 

We would like to mention the article of Menares [22] . We learned the idea of equidistribution 
in supersingular Hecke orbits from his article. He proved that the Hecke operators Tm for the 
group GL2(Q) act with equidistribution on the supersingular stratum of the modular curve 
Xo{p). 
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Consider the class of Shimura varieties of Kottwitz [IB] . Such varieties are associated to a 
division algebra D whose center is a CM field F. We will embed F into the complex numbers, 
and we assume the field F splits into a compositum F = ICF~^ of a quadratic imaginary 
number field /C C C and a totally real number field F^. 

For any commutative Q-algebra R, the group G{R) is by definition the group of elements 
g € D M such that xx* £ . li K C G(Af) is a compact open subgroup, sufficiently 
small, then we have a variety Shx defined over the reflex field E. Let p be an ii^-prime where 
the variety Shj^ has good reduction in the sense defined by Kottwitz |17] . In particular Shx 
extends to a smooth and proper scheme defined over Oe^- We write Fg for the residue field 
of -E at p. Let p be the rational prime number under p. We fix an embedding Vp-. E ^ Qp 
compatible with p. 

Throughout this article we assume that the prime number p is split in the field fC. Let B be 
the supersingular locus of Shx.F, [25]. Furthermore, we assume throughout that i? is a finite 
variety. In fact, among the set of all Kottwitz varieties, this rarely happens. However, the 
class of varieties with finite basic stratum is still quite interesting; it contains all the varieties 
considered by Harris and Taylor to prove the local Langlands conjecture [12j . The condition 
that B is finite corresponds to a condition on the signatures of the unitary group at infinity 
and the decomposition of the prime number p in the field F^. More explicitly, let U G G 
be the subgroup of elements with trivial factor of similitude. Then U{M) is isomorphic to 
a product of real, standard unitary groups U{s vjTi s^,), where v ranges over the infinite 
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1. Some simple Shimura varieties 
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F+-places. We may, and do, assume that < ^n. The field is embedded into Q C C and 
also in Qp, and therefore the group Gal(Qp/Qp) acts on the set of infinite F"'"-places. In case 

> 1 for some v, then certainly B is infinite. Assume that < 1 for all v. Then the variety 
B is finite if and only if = 1 for at most one infinite F''~-place in each Gal(Qp/Qp)-orbit of 
infinite F^-places. For the proof of this statement, see [19^ § 4.3]. 

Via the embeddings Q D C Qp, any F^-place p above p defines a Gal(Qp/Qp)-orbit 
of embeddings ^ Q. We define numbers Sp by Sp := J2vep each p\p. Due to our 

assumptions on the s„ we have Sp G {0, 1} for each p. 

Let A be the free complex vector space on the set B{¥q). The Hecke algebra 'H{G{A{)/ /K) 
acts on the variety B through correspondences and on the vector space A via endomorphisms. 
Let /oo be a function at infinity whose stable orbital integrals are prescribed by the identities of 
Kottwitz in [15]; it can be taken to be (essentially) an Euler-Poincare function [161 Lemma 3.2] 
(cf. [8]). The function has the following property: Let tToo be an (g, i^oo)-module occurring 
as the component at infinity of an automorphic representation tt of G. Then the trace of /oo 
against tToo equals the Euler-Poincare characteristic A^oo(— 1)* dimH*(0, Kqo; vToo ® 

where N^o is a certain explicit constant (cf. [16, p. 657, Lemma 3.2]). 

We use the following space of automorphic forms: A{G) = L'^{G{Q)\G{A),cl!), where oj is 
the trivial central character. 

For every Hecke operator fP G 'H{G{K\)//K) we have (cf. [H]): 

(1.1) T,{r®lK,.A) = e 1^(/oo/,vrP)+ ^ Tr(/oo/, tt^), 

7rC,4(G),7rp Steinberg type ndAiJJ), dim(7r)=l 

where the sign e equals (— 1)*("~^) with t the number of infinite -F~'~-places v such that = 1. 
We recall the definition of "Steinberg type" from our previous article (cf . [181 Def . 4] ) : 

Remark. The module A is semi-simple as ^(G(A£))-module because all its irreducible sub- 
quotients lie in the discrete spectrum of G. 

Definition 1.1. A smooth representation vTp of G(Qp) is of Steinberg type if, (1) For all 
F^-places p above p we have 



Generic unramified Sp = 0, 



where (f)p is an unramified character, and (2) The factor of similitude of G(Qp) acts 
through an unramified character on the space of TTp. 

We will use the result in Equation (jl.ip to deduce an equidistribution statement of Hecke 
operators acting on the basic stratum B{¥q). 

2. Hecke operators 
Let {TmlmsN £ T~i{G{K{)) be a sequence of Hecke operators such that 
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(HI) Tjji = T^^y is an elementary tensor of local Hecke operators. 
(H2) Tm^s = ^Ks foi' ^-ll m £ N, where S is a finite set outside which the data {G, K) 
is unramified, K decomposes into K = KsK^, Ks C G{As) compact open and 
C G{Af) hyperspecial. 

(The first condition is only there for notational convenience.) 

There is an important condition on the sequence {Tm}mmi before we can prove equidis- 
tribution. We define deg(rm) := Tr(Tm, 1). 

We define a number N{Tm) & IK>0; ^ follows. Let £ be a prime number coprime to S. 
Let be the ^-th component of Tm- Let be a maximal split torus in Gq^ with rational 
Weyl group W^, and let Xy;/gx*(T^) '^^i^^ " 

[v] G C[X*(T£)]^'^ be the Satake transform of Tm- We 
define Ni{Tm/) := I]i.ex.(T) and NiTm) := He^s ^dTm/) ■ 

We require on the sequence Tm that 

(H3) hm = 0, 

m^oo deg(rm) 

(cf. Equation (j4.ip ). In Section [5] we give an example of a sequence of Hecke operators 
satisfying conditions (HI), (H2) and (H3). 

Definition 2.1. We define the Hecke algebra T C C^(G(Af)) to be the complex algebra 
generated by the operators Tm- 

Remark. The operators Tm commute with each other, thus the algebra T is commutative. 



3. Hecke orbits 

The Hecke algebra T does not act transitively on the basic stratum; there are two innocent 
obstructions: (1) an obstruction from the cocenter of the group G, and (2) the Hasse invariant 
Ker^(G, Q), which need not be trivial. We will define certain 'candidate' orbits of 7" acting 
on B. Our main theorem states that the algebra T acts transitively and with equidistribution 
on these orbits. 

The obstructions (1) and (2) are what one expects: For the first obstruction (1): If the 
image of X C G(Af) in the cocenter C(Af) is not sufficiently large (and this will always be the 
case for many C, due to the presence of Abelian class groups), then the double coset space 
G{Q)\{X X G{Af)/K) is not connected. A point in one connected component will be sent by 
a Hecke operator to another connected component only if this operator is non-trivial on the 
cocenter. 

The second obstruction (2) is there because Shi^(C) is not equal to the double coset space 
G{Q)\{X X G{Af)/K), rather it is a disjoint union 

(3.1) ShK(C)= ]J G{q)\{X xG{Ai)/K), 

Keri(G:Q) 



EQUIDISTRIBUTION IN SUPERSINGULAR HECKE ORBITS 



5 



indexed by the group Ker^(G : Q) (this group depends only on the oocenter of G, and is 
trivial in case n is even, see \17\ p. 393]). The Hecke correspondences act on the right hand 
side via their natural action on the double coset spaces. Thus, clearly, over C, all points in a 
Hecke orbit will have the same invariant in Ker^(G : Q). 

Let d: G C be the oocenter of the group. We have the morphism h from Deligne's 
torus S := Resc/KGm to Gr. By composing this morphism with d^M we obtain a morphism 
/i': S — )• Cr. The couple (C, {/i'}) is a zero dimensional Shimura datum. The finite Shimura 
variety Sh(C, {h'}) parametrizes the connected components of the original variety pJJ, i.e. the 
natural morphism 

(3.2) 7ro(G(Q)\(X x G(Af)/K)) C{Q)\{{h} x C{At)/d{K)), 

is an isomorphism. Via this mapping, the action of the Hecke operator / E T-L{G{Af)) on the 
left hand side coincides with the action of the operator ^(/) in T-L{G{Af)) on the right hand 
side. Here the map 'H{G{A{)) — )- ^(C(Af)) is characterized by 



(3.3) [^f] (c) 




Vc e C(Af) V/ e n{G{Af)) : 



f{gh)d,i{h) \ic = ge Im(G(Af) ^ C{A,)) 
otherwise. 



where the Haar measure on Gdcr ( Af ) is the one giving the group K n Gder ( Af ) volume 1 . 

Let E be the reflex field of the datum (G, X). The mapping in Equation (j3.2p is Aut(C/£^)- 
equivariant and descents to an isomorphism of £^-schemes 7ro(Sh(G : K)) ^ Sh(G : d{K)). 
The variety Sh/^ is an union of #Ker^(G, Q) copies of the variety Sh(G : K) [17, §6]. We 
obtain an ^^-isomorphism 

(3.4) ^o(Sh;^)^ ]J Sh{C:d{K)). 

Kori{G,Q) 

Both sides are finite etale E'-schemes and the Gal(Q/£^)-action is unramified at p. Locally at 
the prime p we have a natural model of Shx over the ring of integers O Ep , and we construct 
a model of the right hand side in the straightforward manner: Take the global sections A of 
the scheme IJKeri(GQ) Sh(G : d{K))Ep- Then A is a Qp-algebra; let ^4° C ^ be the integral 
closure of Zp in A. Then Spec(yl°) is our integral model. We write Y = Spec(^°) and view it 
as a as scheme over Oe,p- We reduce the map in Equation (j3.4p modulo p and compose with 
B C Shx^p 7ro(Shi^^p) to obtain the map ip: B ^ Y. 

Let Avg: A ^ Ahe the mapping taking the 'average' of an element v £ A along the fibres 
of the mapping ip: B ^ Y. More precisely, Avg is defined as follows. For each point y £Y we 
have the fibre By of V' above y. Define Ay to be the free complex vector space on the set By{¥q). 
Then A is the direct sum of the Ay with y ranging over the set Y(¥q). For each y G y we have 
the map (of vector spaces): ^y: Ay ^ C, defined by ^^fzBy(¥g) ' I^l '""^ 'l2xeBy(¥g) Write 
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= 'l2x£By(¥g)i^] ^ Define the endomorphism Avg^: Ay Ay, by w H> ^3^'^^) ' 
The fibres By{¥q) are all of the same cardinality #C (I^) / d{K) . Take the direct sum of Avg^ 
over all y G y to obtain the endomorphism Avg: A ^ A. 

We will prove that any element v £ A will converge to its average under the action of the 
sequence of Hecke operators Tm G T. 

The complex vector space A is finite dimensional and therefore carries a norm | • | , uniquely 
defined up to equivalence of norms. Using this norm we may give the precise statement of 
the main theorem: 

Theorem 3.1. LetTm be a sequence of Hecke operators satisfying conditions (HI) and (H2). 
Let V £ A be an element. There exists a constant C G M>o such that for any e > there exist 
a natural number M such that for all m > M we have 



^^^""^ vi,(r^)(Avg(r;)) 



deg(r„) 



< c- 



deg(r„ 



Proof. In Section m we prove Theorem 13. II □ 

Now assume additionally that the sequence Tm satisfies condition (H3) saying that 
limm_!.oo '^^J^y = 0. Then Theorem 13. II gives an equidistribution statement for the sequence 
Tm acting on the basic stratum. 

In Section [5] we explain what Theorem 13.11 says for a concrete example. 

Remark. Theorem 13.11 gives a bound on the rate of convergence: The sequence ^^'^ ^ con- 
vergences to the sequence ^'(rm)(Avg(f )) with at least the speed of convergence of the limit 
limm-s.00 deg^'') ~ ^' This convergence bound is the optimal bound coming from the Ra- 
manujan conjecture. 

Let us discuss in some more detail the statement of Theorem 13.11 Strictly speaking, The- 
orem [3TI] does not say that the sequence {Tm{v)/ deg{Tm)) converges; its says that the terms 
of this sequence get arbitrarily close to the terms of the sequence ^(Tm)(Avg(t;)). If one 
chooses a sequence of operators Tm such that the operators '^{Tm) are non-trivial for an 
infinite amount of times, then the sequence ^ {Tm){^^g{v)) does not converge; it will vary 
over a finite set of values. Thus, in those cases, our theorem actually says that the limit 
\\m.m^oa{Tm{v) / deg(Tm)) docs not exist at all. 

This behavior is completely normal and understandable: Already in the classic, complex 
setting, equidistribution is false (in the strict sense) when the group has non-trivial cocenter. 
To convince the reader, we consider a Shimura variety for the multiplicative group G^a'- Con- 
sider the set Sn '■= (Z/A^Z)^ viewed as a variety over Q by identifying Sn with the A^-th 
primitive roots of unity /i]^. A natural sequence of Hecke operators acting on this variety is 
the sequence of operators Tp induced by the p-th Frobenius element acting on (Q) {p not 
dividing A^). The operator Tp acts on the complex valued functions / on Sn by multiplication: 
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Tp • f := {x ^ f{px)). Clearly, the limit lirrip^oo 7p(/) does not exist in general, only if one 
imposes a condition like p = 1 mod N. 

Thus, returning our original Shimura datum and our original sequence T^, one can do two 
things to get equidistribution in the strict sense: 

• Restrict the sequence of Hecke operators to range only over those Tm acting trivially 
on the cocenter (i.e. "ifiTm) acts by multiplication with deg(Tm)), yielding certain 
conditions on the numbers m; 

• Restrict the space of vectors v £ V, and consider only those v such that the Hecke 
algebra acts by multiplication with its degree on Avg{v). 

We choose to keep the slightly more complicated statement of convergence involving several 
limit points. 

4. Equidistribution for Kottwitz varieties 

We prove Theorem 13.11 

Definition 4.1. The character formula for A in Equation (11. ID expresses A as a sum of Hecke 
modules of the form {irf)^''. We define Aq C A to be the T-submodule generated by the 
submodules (vr^)^'' C A for vr an infinite dimensional automorphic representation of G(A). 

The following Proposition proves the essential part of Theorem 13.11 

Proposition 4.2. Letv G Aq. LetTm G 'H{G{A{)) be a sequence of Hecke operators satisfying 
conditions (HI) and (H2). There exists a constant C G ]R>o such that for all natural numbers 



Proof. Of course, by multiplying with the degree, it suffices to show that |Tm(f )| < C\N{Tm)\ 
(for some constant C, not necessarily the same constant as in the Theorem). By our Theorem 
in Equation (jl.ip it suffices to prove this inequality for each vector v G vr^ in each automorphic 
representation vr contributing to the character formula of Aq. Let vr be one of these cuspidal 
automorphic representations. We use base change to send tt to an automorphic representation 
BC{tt) of the algebraic group IC^ x (see [2]), and we send the automorphic representation 
BC{'k) to an automorphic representation H := JL{BC{tt)) of the algebraic group := 
/C^ X GL„(F) (see |27j and [4]). This automorphic representation is discrete. At p we 
have G^{Qp) = G{Qp) x G{Qp) and Hp is isomorphic to vr^ (g) vr^. The representation vTp is 
essentially square integrable because it is an unramified twist of the Steinberg representation, 
and therefore Hp also has this property. The representation H is then forced to be cuspidal 
by the classification of Moeglin-Waldspurger of the discrete spectrum |23] . 

Because H is cuspidal the Ramanujan conjecture applies to it. This conjecture is true for 
H because H is obtained by base change and Jacquet-Langlands from an automorphic repre- 
sentation TT of an unitary group (of similitudes). Thus H is conjugate self-dual. Furthermore, 



m we have 



Tm{v) 

deg(T„) 



< C- 



deg(r„) 
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n is cohomological because Tr(/oo,7roo) / 0. For such representations 11 the conjecture is 
proved to be true in the articles [6l[71[26]. Consequently the components Il\ are tempered 
GL„(F;j)-representations for all primes A of F. 

Let ^ be a prime not lying in S. Then Hi is the base change of vr^. We know that 11^ is 
unramified and tempered, and we know that vr^ is unramified as well. Therefore, ng must be 
a tempered representation of G{Qi). 

Let ^ be a prime number not lying in S. The representation vr^ is tempered, and there- 
fore the absolute values of the eigenvalues of its Hecke matrix ip.,^^ are all equal to 1. Let 
SiyeJf*(T^) (^A^] ^ C[Tf]'^'^ be the Satake transform of T^ i. Because cp is tempered we have 



(4.1) |Tr(r„,^,7r^) 



< \cu\=Ni{T„,). 



Take the product over all I to get the estimate of the theorem. □ 

The proof of the main theorem for Kottwitz varieties is now not more than a formality: 

Proof of Theorem \3. 1[ We have the composition ip: B ^ Sk,p 7ro(5'j<-)p- The Hecke oper- 
ator / acts via ^(/) on 7ro(S'x)p = Y- The map "0 induces an inclusion of the free complex 
vector space on Y{¥g) into A: i: AA_h ^ A. The composition Avgo i is the identity on A^h- 
Thus Avg induces a decomposition A = ^Ab © Ker(Avg). We claim that Ker(Avg) = Aq, 
the subspace generated by the infinite dimensional automorphic representations. To see this, 
note that is the sum of precisely all the one-dimensional automorphic representations of 
G(A) occurring in the character formula of A (Equation (jl.ip ). The remaining (infinite di- 
mensional) representations thus account for A/A^y, = Ker(Avg). Thus Ker(Avg) = Aq. The 
composition B C Sk,p Tro{SK)p is equivariant for the Hecke operators. Thus we have the 
formula / • i{v) = i{^{f)v) for all v G and all Hecke operators / on G(Af). The theorem 
now follows: For v = vo + VAh, we have Tmiv) = Tm{vo) + Tm{vAb) = Tmivo) + ^{Tm)Avg{v). 
The sequence Tm{vo) is estimated by Proposition 14.21 This completes the proof. □ 



5. A TYPICAL EXAMPLE 

We give two typical examples of sequences of Hecke operators for which one can prove 
equidistribution. 

First example. Look at a sequence of powers of a fixed operator: Let T G 7i{G{A{)) be one 
Hecke operator satisfying the conditions (HI) and (H2) above, and A^(T)/deg(T) < 1. Then 
the sequence of powers Tm ■= (T)*^ for the convolution product * satisfies limm^oo deg^\ ~ 
0. By Theorem 13. II the sequence thus acts with equidistribution on the basic stratum. 



EQUIDISTRIBUTION IN SUPERSINGULAR HECKE ORBITS 



9 



Second example. We define an explicit sequence of Hecke operators T^^^ £ T~iiG{Af)), 
where m ranges over the square free integers, and r ranges over the integers 1 < r < n — 1. 
Consider the Q-group G+ := ReSfc/qGic with G+(Q) = /C^ x . Let S" be a finite set of 
finite, rational primes, such that: 

(1) for all primes i not lying in S, the group is a product of general linear groups 
over finite, unramified extensions of Q^; 

(2) K splits into a product K = KsK^ , where Ks is a subgroup of G(Af 5) and K'^ is a 
subgroup of G{Af); 

(3) the prime p lies in 5; 

(4) the group is hyperspecial. 

Let be the Q-group /C^ x GL„(i^). Then G"*" is an inner form of G+, and we have 
G'^iQi) — G+{Qe) for all primes i not in S. The group G^ has an obvious model over Z, and 
thus we have the hyperspecial subgroup G^(Z) C G+(Af). Let m and r be integers, where 
we have < r < n (no condition on m). Then, by definition, the operator is defined to 
be the characteristic function: 

(5.1) r+„ := char ^G+(Z) • (1) x diag( m, m,. ..,m , 1, 1, ... 1) • G+(Z) j G ?^(G+(Af)), 

where we should clarify the notation. We have G^(Z) = Oj^ x GL„(C'j?), where is the 
factor of similitude. With (1) x diag(. . .), we mean an element of G"'"(Z) that has trivial factor 
of similitude, and diag(. . .) describes a diagonal matrix in the general linear group over Op- 
Because the group G+(A^) is isomorphic to G"'"(A£'), the operator = -^'■^."^ ^^^^^ 

also in the algebra 'H(G+(Af )). We have the base change morphism 

BC: n{G+{Af)//G+{Z')) ^n{G{Af)//K'). 

We define the operator to be BC(T+^), and we define 

(5.2) Tr,m := Iks ^ T^,m ^ G^{G{Ai)/ /K). 

We now verify that limm,r^-oo Tr^m 0. Because we have an explicit sequence, one can 
give explicit bounds: 

Proposition 5.1. Let e > 0. There exists an integer M > such that for all square-free 
integers m > M all integers r with \ < r < n — 1, 



I r(n — r) 



deg{Tr^r 

Before proving Proposition 15.11 we first prove two lemmas. 
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Lemma 5.2. There exists a constant C G M>o such that for all square-free integers m > M 
and all integers r with 1 < r < n — 1 we have 

N{Tr,m) 
deg{Tr^rn) 

Notation. Let m be a positive integer, unramified in F. In the lemma above we wrote CF{m) 
for the number of O^^-prime ideals A containing the number m. 

Lemma 5.3. Let e > 0. There exists an integer M > such that for all integers m > M we 
have QY^^""^ < m'. 

Clearly, Proposition 15.11 follows once the two lemmas have been established. Let us now 
prove the two lemmas. 

Proof of Lemma \5.Si Let ^ be a prime divisor of m. Because m is square free, the prime £ 
divides m precisely once, and the £-th part of the function equals 

(5.3) char (G+(Z,) • (1) x diag(A ^ . . . , A 1, 1, • • • , 1) • G+{Z,)) G n{G{q,)). 

The element (1) x diag(^, £,...,£,1,1,...,!) G G^{Q_() is the evaluation at ^ of a miniscule 
cocharacter /i^ G X^,{G^). The field F is unramified above i, and therefore ^ is a prime 
element of the local field Fx for every F-place A dividing £. Because //^ is miniscule there is 
a simple formula for the Satake transform of T^^m (cf. |13j): 

r(n — r) 

(5.4) 5(T+W) = lC5(g)g7^ X,,X,,...X,^, 

\\l \<ii<i-2.<-<ir<n 

in the algebra 

(5.5) C[X,(TqJ] = C[Z] » (g) C\Xf\xt\ ....Xt\ 

\\l 

where Tq^ C Gq^ is the diagonal torus. We specify that the big tensor product in these 
equations ranges over all the -F-places A lying above ^, and for such an F-place A, we write 
q\ for the cardinality of the residue field at A. 

Note that, up to constant (which we ignore), the degree deg(Tr^m,£) equals deg(Tj,^^ ^). The 
degree deg(T^'*'^^) is the evaluation of the polynomial S{T^^^ at the Hecke matrix of the 
trivial representation v?Triv; and is therefore made completely explicit at this point. We may 
now estimate |5(r^^^ ^)(93Triv)|- If we evaluate the symmetric polynomial 

l<il <i2<---<ii<™ 

at the Hecke matrix of the trivial representation of GL„(Fa)) then the largest appearing 
monomial is g^" i)/2+(n 3)/2+...+(n 2r+i)/2 _ ^r(n r)/2^ Hencc the following lower bound: 

r(n-r) r(n-r) 



< C 



m 



„, r(n—r) 
-[F:Q]-4-^ 
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here Csat is a certain constant. We have 

(5.7) \N{Tr,^^,\ < |iV(T+^,,)| = Csat n (^) = ^Sat 

The lemma foUows by combining Equations (15. 6p and (15. 7p . □ 

We prove Lemma [5 . 3 1 only for F = Q; we leave it to the reader to reduce to this case, or to 
extend the argument below. 

Proof of Lemma \5.3[ We have {cQ{m))l < m. Write m = T(x) for some x E M>o where T is 
the usual Gamma function. Then CQ(m) < x and from Stirling's formula we get 

CQ{m) CQ{m) 1 

log(m) log (\/27ra;e-^x^) ~ log(x) - 1 + i°g(^^) 

The right hand side converges to for x — )• oo. Thus we may find (for any e > 0) an M such 
that exp(cq)(m)) < m"^ for all m > M. This completes the proof. □ 

Applying Theorem 13.11 to the explicit sequence Tr^m we get 

Corollary 5.4. Let v ^ A he an element. Then there exists a constant C G M>o such that 
for any e > there exist an index M , such that for all square-free integers m> M and all r 
with 1 < r < n — 1 we have 

6. Endoscopic unitary Shimura varieties 

We extend result of our article [18] to a larger class of endoscopic unitary Shimura vari- 
eties satisfying a technical simplifying condition (Hypothesis 16. ip . We prove later that this 
condition is satisfied for unitary Shimura varieties whose basic stratum is finite. 

We consider a Shimura variety of PEL-type, of type A, as considered by Kottwitz in |17j . 
We assume fixed a PEL-datum consisting of 

(Al) A simple algebra0 Y over a CM field F; 

(A2) A positive involution on the algebra Y inducing complex conjugation on F] 
(A3) A Hermitian Y-module (F, (•,•)), where (•, •) is symplectic; 

(A4) /i: C — )• Endy(y)iR is a morphism of M-algebras such that h{z) = h{z)* for all z £ C. 
Let {G,X) be the Shimura datum associated to (Al), (A2), (A3) and the morphism h~^ . 
We assume that F is of the form ICF^ , with /C/Q a quadratic imaginary extension of Q and 
F a totally real extension of Q. Then the group G/c is isomorphic to a product of (Weil- 
restriction of scalars of) general linear groups. We let p be a prime of good reduction in the 
sense of Kottwitz \17\ §5] and we assume that p splits in /C/Q. We write E for the reflex 

^The notation Y is nonstandard and questionable; we use it because the usual notation B conflicts with 
our notation for the basic stratum. 
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field of the Shimura datum. Furthermore we let K C G(Af) be a compact open subgroup of 
the form K = KpK^, with Kp hyperspecial and sufficiently small so that the PEL- type 
moduli problem of level K is defined over Oe 'S> ^(p) and the variety Sh^^ is smooth and 
quasi-pr o j ective . 

Pick an S-prime p above p and let B be the basic stratum of the variety Sh.K,Wq, where ¥q 
is the residue field of O^; at p. We pick an embedding of Q — >• Qp extending the embedding of 
E into Qp defined by p. We fix once and for all an embedding of F into C, and Q will always 
mean the algebraic closure of Q in C. The field is the residue field of Qp and the field Fg 
is the residue field of £' at p. 

Because we have the embeddings F C Q C Qp, the Galois group Gal(Qp/Qp) acts on the set 
of infinite -F~''-places V{F~^) and we may identify any p\p with a Galois orbit V{p) of infinite 
places. Let U C G he the subgroup of elements with trivial factor of similitude. Then C/(M) 
is a product of standard real groups: C/(M) = nt;eV'(F+) ^( 

Sy^Ti Sy^ for certain numbers Sy. 
We assume that < so that these numbers are well defined. For each F"'"-place p above 
p we define Sp := Ylvep (^^^ § P)- '^^^ additional technical condition is the following: 

Hypothesis 6.1. There exists an -prime p such that the number Sp is coprime to n. 

Theorem 6.2. Assume Hypothesis \6. 1\ is true for the Shimura datum {G,X). The sum 

(6.1) Yl Tr($p"x/-P,.*(Q,W, 

equals 

7r,dim(7r)=l,7rp=Unr 

(6.2) ^ m(7r)CP(g-).Tr(/P,7rf), 

7r,7rp=St. type 

where in both sums vr ranges over the discrete automorphic representations of G. The number 
r equals the number of F^ -places p\p such that Sp > 0. 

Proof. Let q be a integer. Consider the function / = foofaf^ in the Hecke algebra of G, 
where foo is a Clozel-Delorme function for the trivial complex representation of Gq and 
G T-L{G{A^)) is any i^^'-spherical Hecke operator. Let ^ be a prime number different from p 
and fix an isomorphism = C of abstract fields. Without further mention, we will use this 
isomorphism to turn the complex valued function fP°° into a Q^- valued function in the cases 
where this is necessary. Write l for the inclusion B ^ Shj^^Fq- Recall that the article |17] 
gives the result: 
(6.3) 

Y Tr($-x/-P,.*(Q,),) = |keri(Q,G)| ^ c(7o; 7, <5)0^(/°°^)TO,(<Aa), 
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where the notations are from [§19, loc. cit]. We restrict this formula to the basic stratum B 
by considering on the right hand side only basic Kottwitz triples. The equation then becomes 

J2 Tr($p°x/-^.*(Q,)J = 

P 

(6.4) =\kev\Q,G)\ ^ 0(70; 7, 'J)0^(/°°^)m(Xaf Va), 

(7o;7>'5) 

where E^^a is the unramified extension of degree a of Ep (in Q^). The function Xo-c is 



the characteristic function of the subset of a-compact elements in G{Ep^ct), and Fixfc^ roop is 



the fibre product Fix<j,ax xaB, where A is the diagonal variety in Sh^.F, x Sh^^^p^. 

By the stabilization argument of Kottwitz in [15] the right hand side of Equation ([67 
simplifies to 

(6.5) Y.L{G,H)-STtixc^^^h), 

£ 

where 

• £^ is the (finite) set of (representatives of equivalence classes) of endoscopic groups H 
associated to G and unramified at all places where the data (G, K) are unramified. 

• ST* is a sum of stable integral orbitals on the elliptic (G, iif)-regular elements in 
H{Q) [E]; 

• h £ ?^(//(A)) are certain functions depending on / (and q, fi, G, H) described through 
their stable orbital integrals in Kottwitz [I5j; 

• l{G, H) is a certain explicit rational number. 

The notation Xc^^^^h is slightly abusive because /i is a global function while x^^'^^^ is a 
function at p. When we write the product x^'^'^^'^h we actually mean the function W 
iXc^'^'''' hp), so the truncation only occurs at p. Before we finish the proof of Theorem 16.21 we 
prove some lemmas: 

Lemma 6.3. Let P C G(Qp) be a proper standard parabolic subgroup o/G(Qp). Then the 
truncated constant term xf^'^^^fcf'^ vanishes. 

(p) (P ) 

Proof. Let P be a parabolic subgroup of G(Qp). We have /A" ' = 1^-. ® 0^,^ U fnJi', where 

Pp is the p-th component of P. If P is proper, then Pp is proper as well. Pick some p\p such 

that Sp is coprime to n (Hvpothesis 16. ip . We look at the p-th component fa of the function 

fa G ^o(G(Qp)) via the isomorphism no{G{%)) ^ ^o(Q^) ® (g)p|p?^o(GL„(F+)). In the 

notation of [18], we have fa = fna^sv [Prop. 3.3, loc. cit.]. These constant terms vanish for 

the proper parabolic subgroups in case s is coprime to n [Lem. 1.9, loc. cit.]. □ 

Lemma 6.4. For any proper endoscopic group HofGwe have {xc^^"^ f)^ = 0. 

Proof. The transfer / ~^ f^ from the function on G(A) to the endoscopic group H{A) factors 
through the transfer from G to its quasi-split inner form G* . At p, the group G(Qp) is quasi 
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split and therefore G{Qp) = G*(Qp) and we take the transfer from functions on G(Qp) to 
functions on G*{Qp) to be trivial. We transfer the function x'c^'^^^ fa on G*{Qp) to H{Qp). 
We first consider the function fa G ^^oiG*{Qp)) {Hq denotes the spherical Hecke algebra). 
In Section 3.4, case 2 on page 1668 of [26], Sug Woo Shin describes explicitly the transfer 
for quasi-split similitudes unitary groups. He starts by describing the endoscopic groups, and 
explains that any H can be identified with a group of the form G{GU* {ni) x GU*{n2)) with 
n = ni + 712 (there are some conditions on the possible partitions n = ni + n2 here, but they 
are of no importance to us) . In particular we assume H is the Levi-component of a maximal 
standard parabolic subgroup Ph of G* . By the second last displayed formula on page 1668 of 
[loc. cit] the transfer of fa to a function on H{Qp) is given by J^^^^^f^^ . xt7,u: where xi,M is 
some function which we will not need to specify for our argument. The transfer of a conjugacy 
class in H{Qp) to a conjugacy class in G*{Qp) is the obvious construction (i.e. induced from 
the inclusion H{Qp) C G*{Qp)). Consequently the function 



is a transfer of the function Xc ^ fa to H{Qp). Therefore the transfer vanishes by Lemma 



A function h is called cuspidal if for every non-elliptic semi-simple conjugacy class 7 the 
orbital integral 0^{h) vanishes. 

Lemma 6.5. The truncated function Xc'^'^'^Va is cuspidal. 

Proof. Any non-elliptic conjugacy class of G(Qp) is conjugated to an element of M for some 
proper standard Levi-subgroup M of G(Qp). Let P be the corresponding standard parabolic 
subgroup of G. Then the orbital integral 0^{xi^^'^^'' f) is the product of a certain Jacobian 
factor with the M-orbital integral of 7 of the function y^'^'^p^ fiP) = (Lemma 16. 4p . Thus 
the function is cuspidal. □ 

Continuation of the proof of Theorem \6.^ Langlands stabilized in |21j the elliptic part of 
the trace formula T^ for any connected reductive group@: 



(6.6) 




[631 



□ 



(6.7) 




In Langlands's formula we have the following notations: 

• A; is an arbitrary Hecke operator in the Hecke algebra T-L{G{A{)) of G. 

• T^ is the elliptic part of the invariant trace formula. More precisely 



(A:) := ^ Vol (G^(Q)^g(M)+\G^(A)) O^ik), 



7 



'Langlands assumes additionally that the derived group of G is simply connected. 
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where the sum ranges over (a set of representatives of) the G(Q)-conjugacy classes of 
Q-elHptic semi-simple elements in G(Q), and is the centralizer subgroup of 7 in 
G. The group Aq C G is the split component of the center of G, and Ag'(I^)~'' is the 
topological neutral component of the set of real points of Aq- We did not normalize 
any Haar measure; for the correct normalizations we refer to Arthur [3]. 

• i{G, H) G Q is a certain constant not depending on k (but it does depend on H and 
G). The constant is defined in [HI §8]; we do not repeat its definition here. 

• ST^ is the elliptic part of the stable trace formula for the group H [3]. 

• is an endoscopic transfer of the function k to the group H{Af). See [3] for an 
explanation of endoscopic transfer. 

It is customary to write sometimes Tg for T^ when the group G is understood; the same 
remark applies to STg = ST^ and other such notations. 
We have the truncated formula of Kottwitz. 

(6.8) Tr(xf ^''V,^) = Yl <G,H)ST^*{xc^^''^h). 

(recall A is the free complex vector space on the supersingular stratum of the Shimura variety) . 
The functions h S H{A) are described by their stable orbital integrals by Kottwitz in the 
article [_15| . In particular the function hp can be taken to be the endoscopic transfer of the 
(truncated) Kottwitz function to the endoscopic group H{A) [loc. cit., page 180, line 15]. We 
have verified above that these endoscopic transfers vanish. Thus we have STf [x^^'^^^ h) = 
for all proper endoscopic groups H. 

By a result of Morel (and Clozel) we have ST* = STg (use f241 Prop. 3.3.4] and cf. [thm 
6.2.1, loc. cit.], or use fl\ (2.5)]) . Consequently, Equation ()6.8p equals 

(6.9) Tr(xf ^^V, ^) = E H)STf{xf'^'^^h). 

Return to the stabilization of the elliptic part of the trace formula 

(6.10) Tf (xc'^^^^V) = E ^)STf ((x?^^'' V)"") 

Also in this formula only the principal ternj^ remains. Furthermore, the principal term of 
Formula ()6.10p coincides with the principal term of Formula ()6.8p . Thus, the right hand side 
of Formula ()6.8p simplifies to 

(6.11) Tr(xf^^V,^) = T^(x?^^''V). 

We compare {x'c^'^^^ f ) with the invariant trace formula for the group G. We use the 
results from Section 7 of [1]. In this section, Arthur shows that under various conditions 
on the Hecke function k on G(A) both the invariant spectral expansion and the invariant 



•^With the principal term we mean the term corresponding to the maximal endoscopic group G* £ £ of G 
(which is the quasi-spht inner form of G). 
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geometric expansion of the invariant trace formula I{k) simplify. In Corollary 7.3 of [loc. cit.] 
he shows the following. Assume there is a place v such that Tr(/i;„,7r„) = whenever the 
representation ir^ is a constituent of a properly induced representation Ind^^^''}^{a) , where a 
is an unitary representation of M(Qt,) (where P = MN). Under this assumption the spectral 
side simplifies: 



(6.12) I(A;) = J^Tr(A;,i?d: 



isc,tj 

t>0 



(here -Rdisc, t is the t-part of the discrete spectrum, t G M>o, cf. [loc. cit.]). 

We claim that Arthur's condition is true if we take v := p and A; := Xc^^^^f- The group 



}p) is a product of general linear groups, therefore parabolic induction of an unitary 
representation from a proper Levi subgroup is irreducible [5]. The representation vr^ is a full 
induction of the form Indpl^^'l (a) with P = MN a proper parabolic subgroup of G. The 
truncated constant terms of / vanish: ^^^'^''^ f^^C^p)) = Q (for P C G proper). By van Dijk's 
theorem adapted to compact traces [18| Prop. 3] we get 

Tr(xe^^^^V,%) = Tr(xf(^^V^«''U) = 0, 
Thus Arthur's condition is verified. We get: 

(6.13) I(xf ^^V) = j;Tr(x?^^''V,i?disc,t). 

t>o 

(We borrowed the argument for ()6.13p from the proof of Corollary 7.5 in [loc. cit.].) 

The geometric expansion of /(/) also simplifies, because the function Xc^^''^ f is cuspidal 
at two places (namely p and oo). By Corollary 7.3 of [loc. cit.]: 

(6.14) liXc^^'^f) = Tfixc^"^"^/). 
Combining the previous considerations (Eq.'s (|6.7p - (|6.14p ) we get 

TV(xf ^^V,^) = ''(^'^) • ST^iXc^'^'^h) = ^{G,H) ■ STf ((xf ^^V)^) 

= T?(X?^^^)/) = I(X?^^^V) = ETr(x?«^V,i?d.c,). 



We conclude that 

Tr(x?^^-V,^) = 5;Tr(x?^^-V,i?disc,i). 

t>o 

The rest of the argument for Theorem 16.21 is the same as the one we carried out for the 
Kottwitz varieties in our article [18\ Thm. 3] (from Prop. 11 of [loc. cit.] onwards). This 
completes the proof. □ 
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7. EQUIDISTRIBUTION FOR ENDOSCOPIC VARIETIES 

We extend the equidistribution result in Theorem 13.11 to a larger class of Shimura varieties 
of unitary type, but still assuming the basic stratum is finite. 

We continue with the notations of the previous section, thus in particular (G, X) is a PEL- 
type Shimura datum with G a unitary group of similitudes. We write B for the basic stratum 
of S. The condition that B is finite is a condition on the signatures of the group G: 

Proposition 7.1. The basic stratum B is finite if and only if we have 
-k for all -primes p dividing p we have Sp G {0, 1}. 

Lemma 7.2. The condition -k is true if and only if P{q") = 1 for all positive integers a. 

Proof. The last example in Section 1 of |18) . □ 

Remark. It is possible that Proposition 17. II can, knowing that the basic stratum is non-empty, 
be proved using a simple deformation theory argument. 



Proof of Proposition 7. 1 , "<;=" Enlarge the divisibility of a so that the root of unity is 1 for 
all automorphic representations contributing to Equation ()6.ip (which are finite in number). 
Equation (|6.2p simplifies to 



(7.1) m(7r)-Tr(r,^^') + (-l)("-i)'-. m(7r) • Tr(r , vr^). 

7r,dim(7r) = l,7rp=Unr 7r,7rp=St. type 

Take = l_ft-p. The expression 

(7.2) TV($p"x/-^.*(Q,),) 

3;'eFixJ„xy.oop(F9) 



is constant when a is sufficiently divisible. Therefore B is finite. 

"=^" We use results from our preprint |20] . In the proof of the main theorem of that 
article we construct a Hecke operator / S T-L{G{A{)) such that the trace of / against 
Y^'^Q{—iyii^{Bf: ,L*C) is, for a sufficiently divisible, equal to a certain non-zero constant 



times Tr{x^^'^''^ faj ^p) where iTp is an unramified twist of the Steinberg representation. From 
the explicit computation of the compact trace against the Steinberg representation [181 snd 
of §1], the trace Tr(x?^^''Va 

, vTp), is, for a sufficiently divisible, a polynomial in of strictly 
positive degree d > 0. Now view H := X]£o(~-'-)*-'^*(-^Fg' '■*'^) ^ ^ virtual representation 
of the absolute Galois group Gal(Fq/Fg). Writing this module as a linear combination of 
characters of the group Gal(Fq/Fq), we know that in this expression the character $ i— )• g"^ 
must appear with non-zero multiplicity. This means that the dimension of B is at least d. 
We know that d > 0, thus B must be infinite. □ 



Hypothesis 7.3. We assume henceforward that the basic stratum B is finite. 
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Definition 7.4. Let A be the free complex vector space on the set B{¥q). Then A is a 
module over the Hecke algebra 7i{G{Af)). 

Fix an integer a, sufficiently divisible so that B{¥q) = B{¥ga). Then (as usual, using the 
fixed isomorphism = C) the expression in Equation (j7.2p becomes the trace of on the 
complex vector space A (Definition I7.4p . Thus Equation ()7.ip equals Tr(/^, A). We have re- 
established Equation (II. 1|) , but now for the larger class of Shimura varieties considered in this 
section. Repeat the argument for Theorem 13.11 using Equation (|7.ip instead of Equation (II. ip 
to find that the equidistribution result is true with exactly the same rate of convergence as 
before. 

8. A REMARK ON THE FINITENESS CONDITION? 

To end this article, we make a short speculation on the case where B is not finite. When the 
basic stratum is non-finite it contains finer sub-stratifications. These finer substratifications 
are preserved by the outside-p-Hecke operators. Therefore, one does not expect equidistribu- 
tion in the whole basic stratum, but only inside these finer strata. If one wants to use methods 
similar to those of this paper to prove equidistribution in the finer strata, one first has to show 
that the cohomology of finer strata admits an automorphic description. In many cases, we 
think, this description will involve also automorphic representations whose local components 
are non-tempered, but still infinite dimensional (contribution of the residual spectrum of 
GL„). This means that one will get a slower convergence rate than the one we got in this 
article. 
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